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ABSTRACT 

Bilingual education programs for Mexican-American 
preschool and elementary grade pupils almost invariably include some 
type of instruction in English as a second language (ESL) . Usual ESL 
Programs for young Spanish-speaking children are found to emphasize 
pronunciation drill (minimal-a pair drills: pit-bit, choose-shoes) • 
An alternative approach deempha sizes phonological drill, 
concentrating instead on teaching of word order of new language 
(syntactic structure) . Results of several studies from bilingual 
projects in Lower Rio Grande Valley show that Experimental groups 
perform no better than Control (no formal ESL instruction) groups on 
Pronunciation, Vocabulary, and Communication scales of Michael Test 
of Oral English- Language Production (MTOEP) , but that Experimentals 
scored significantly (•001) higher on Structure. Hypotheses advanced 
are that young children may benefit only slightly by repeated drills 
in pronunciation and vocabulary* Primary grade children learn 
pronunciation by modeling* (Author/CK) 
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A. Title: An Evaluative Study of Instructional Strategies and Pupil Cognitive 
Learning in an English as a Second Language Program of a Spanish- 
English Bilingual Education Project. 
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C. Suicnary: Bilingual education programs for Mexican-American preschool and 
elementary grade pupils almost invariably include some type of instruction in. 
English as a second language (ESL). . Usual ESL Programs for young Spanish- 
speaking children are found to emphasize pronunciation drill (minimal-pair 
drills: pit-bit , • choose-shc-es) . An alternative approach deemphasizes phonological 
drill, concentrating instead on teaching of word order of new language (syntactic 
structure) < Results of several studies from bilingual projects in Lover Rio 
Grande Valley show that Experimental groups perform no becter than Control (no 
formal ESL instruction) groups on Pronunciation, Vocabulary, and Communication 
scales of Michael Test of Oral English Language Production (MTOEP)., but that 
Experimental scored significantly C-001) higher on Structure! 

Interpretation (and hypotheses) advanced are that young children may benefit 
only slightly by repeated drills in pronunciation and vocabulary. Primary grad^ 
children seemingly learn pronunciation readily by modeling after competent 
English-speaking tesciiers, although pronunciation drill may be necessary for 
older learners with more established .speech patterns that muse be overcome. 
Formal syntactical drill to lesrr. word order of the new language may be more 
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important than phonological analyses in ESL instruction. Vital question for 
bilingual projects: lf Are children being exposed to ESL language teaching 
strategies that are redundant and more relevant for adults and older children?" 
Multi-project evaluative research, within USOE Guidelines on Accountability, 
is urgently needed and possible now. 
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SUMMARY 

Objectives of Study : 

Title VII of the Elementary and Secondary Education Act has spurred develop- 
ment of bilingual education programs. Although conceptual philosophies of what 
constitutes bilingual education vary widely, most bilingual programs include 
some form of instruction in English as a second language CESL) . First, this 
paper investigates the effectiveness of a widely-used basic oral English language 
program, the ROCK materials, designed for preschool and elementary grade pupils 
in the Southwest whose native language is Spanish. 

Second, the results are examined for implications to teaching of English 
as a second language. The ROCK (Region One Curriculum Kit), materials 1 consist 
of (a) 128 language lessons, originally written at the University of California 
at Los Angeles and termed the H-200 series, plus G>) newly-developed procedures, 
and materials that provide practice in learning of language patterns and that 
reinforce the structure being learned, and Cc) an extensive set of teacher training 
materials. 

This paper reports the results obtained by comparing the learning performances 
of youngsters in various Experimental CESL) Groups with those of pupils in 
Control (no formal ESL instruction) Groups on a test of oral English, production. 



"hrhe ROCK materials are distributed by the Helton Book Company, Inc., Ill Leslie 
Street, Dallas, Texas 75207. 
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Methodology : 

The effectiveness of the ROCK materials is determined by comparing the 

cognitive learning performances of youngsters in various Experimental (ESL) 

groups with those of pupils in Control (jig formal ESL instruction) groups on 

a test of oral English production during the 1969-70 school year. The Michael 

2 

Test of Oral English Production (MTOEP} was utilized to assess the effectiveness 
of ESL instruction. In the absence of a standardized measure of oral English 
proficiency, the MTOEP possesses adequate content validity for assessing performance 
in spoken English within the range of verbal behavior covered by the. R-200 
language materials. The MTOEP consists of four scales (Communication, Structure, 
Pronunciation, Vocabulary) and a Total Score, 

The MTOEP is an individually-administered test with very sitrict standard 
of administration, even though considerable dialogue vith teatee. goes on. The. 
examiner must appropriately employ alternate-channeling and question-restatement 
procedures. High inter-scorer reliability was achieved by first training 
prospective scorers in test administration, and then having them score a standard 
set of five tapes containing "live data," varying in scoring difficulty, to 
95% accuracy with the scoring criterion. Both, examiners and scorers were 
trained in one or two week institutes conducted by psychometrists and linguistically- 
trained personnel at the Southwestern Cooperative Education Laboratory, Albuquerque, 
New Mexico. 

Schools in which ROCK materials have been employed are in communities in 
the Lower Rio Grande River Valley of Texas wherein Mexican Americans constitute 



'The MTOEP is net available commercially. Examination copies and further 
information on the availability of the MTOEP is available from either of the 
authors. A revision has been accomplished by the Southwestern Cooperative 
Education Laboratory, 117 Richmond, is.E., Albuquerque, New Mexico. 
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70-852. of the total population. In each of the four studies to be reported, 
random samples of pupils in Experimental classrooms were drawn and tested at 
the end of the year- Control group pupils were selected either from non-experinental 
classrooms in the same school as the experimental classrooms, vhere teachers 
were not using the ROCK materials, or from comparable classrooms in nearby 
schools. All pupils speak little or no English at the start of school, conse- 
quently a pretest is not given to first year (kindergarten or first grade) 
pupils. 

Data Analyses : 

Analyses of variance were performed to determine differences between 
experimental and control group means on the four part scores and total scores 
of MTOEP at the end of the first grade. 

Results of Study I: Subjects were 80 preschool or first grade Mexican-American 
pupils. 

ANOVA results are presented in Table 1. Only the Structure scale showed 
a significant difference between the Experimental and Control Groups. 

Table 1; MTOEP Results 
Experimental Group Control Group 



Mean (N=40) Mean (N=40) P 

Communication 70.07 67.50 HS 

Structure 50.23 32.39 .001 

Vocabulary 50.00 47.62 NS 

Pronunciation 24.05 23.99 NS 

Total 195.35 171.50 .001 



Additional Studies : 

In another study, kindergarten and first grade pupils in ROCK ESL class- 
rooms were compared with control youngsters in non-ESL classrooms. Testing 



with the MTOEP was accomplished during late Spring 1970 at the end of the school 
yeae. Table 2 shows these results. 

Table 2: MTOEP Results 

Experimental Group Control Group 

Mean (N«183) Mean (N=21) P 



Communication 
Structure 
Vocabulary 
Pronunciat ion 
Total 



70.13 69.05 US 

50.45 33.31 .001 

50.10 48.00 NS 

24.01 22.96 KS 

194.69 173.32 .001 

In a pilot study investigating the effects of the ROCK ESL program during 
school year 1969-70 with pupils in their second year of school Ceither first 
grade or second grade) , an advanced level of the MTOEP was used as a pretest 
and posttest. The results for Experimental and Control groups is presented 
in Table 3. 

Table 3: MTOEP Results 

Experimental Group Control Group 

Mean Scores (Rounded} Mean Scores (Rounded) 

(tt=29) M-15) 



Pre Post Pre Post 

Communication 49 53 37 48 

Structure 26 39 13 21 

Vocabulary 30 33 29 34 

Pronunciation 26 31 25 30 

Total 131 157 104 131 

Although Ns are quite, small, the suggestion is that the Experimental Group 
pupils, having spent a year in the K0CK ESL Program, are considerably higher on 
Communication and Structure at the beginning of the year and that Control pupils 
narrow the gap considerably during the year in absence of formal ESL Training 
in all areas except Structure . 
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Finally, from 1970-71 data Cnot shown here), utilizing a newly-developed 
Structure Test, ROCK (Experimental) group children scored significantly higher 
(P less thati .001) on the posttest than Control pupils, with ability level (measured 
by the Goodenough-Harris Drawing Test) controlled. (Analysis of covariance was 
used to statistically adjust scores in instances where group pretest means differad 
significantly at second year level,) This result , was obtained at both first and 
second year ESL Levels * Detailes on methodology and the scales used will be 
included in the conference presentation. 

Educatio nal Implications of Findings : 

The most obvious difference between Mexican-American youngsters who have 
been exposed to ROCK ESL materials and those who have not is in their control 
' of syntactic structures. Apparently, young children do not improve in pronuncia- 
tion skills in their second language by repeated exercises in such things as 
minimal-pair drills (e.g. pit vs. bit — a slight phonemic change). The Control 
groups which did not receive Such instructional drill, perform equally a? veil 
as the Experimental pupils. Likewise, vocabulary skills, in the sense of picture 
identification, is also known almost as well by youngsters outside ESL program 
as those who have received training with ESL aids. 

One view of these findings is that pronunciation is learned by modeling 
after a competent English-speaking teacher (shoes vs. choose), and that it is 
unnecessary to spend much time on pronunciation practice. Young children in 
particular may not require much phonological analysis. However, phonic analysis 
may be useful to older learners of English as a second language since they already 
have well-developed speech patterns and this drill may serve to override established 
speech habit patterns. Perhaps ye have been applying language teaching strategies 
to children tha t are more relevant for, teaching adults and older children . The 
consistency and replicability of the findings to date indicate that this could 
indeed be the case. 

O 
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On the other hand, syntactic structure drill is necessary for both older 
and younger children because a uew vord order, one that is different from the 
native language, is being learned. Structure nay be the crucial area of ESL 
instruction because, unlike Pronunciation and Vocabulary, English sentence patterns 
are not learned readily. Although sone linguists and seme administrators in 
bilingual-ESL fields would likely resist the notion that Pronunciation and Vocabu- 
lary can be easily learned by youngsters whose native language is other than 
English, yet there is evidence from the ROCK program to support this view and 
that furthermore the teaching of English structure nay be the crucial area of 
instruction in ESL programs. The hypothesis seems worth investigating. Impli- 
cations are seen for formulation of bilingual programs and teaching ESL to pupils 
whose native language is other than English. Opportunities for this research 
exist within the evaluation guidelines presented by the Office of Education in 
its emphasis .on educational accountability. It seems necessary to investigate 
whether the findings reported herein are replicable in other educational-community 
settings where Spanish and English languages are employed in varying combinations 
in tha schools and community settings, such as in retail stores, and city-snaLe 
agencies. 



